System and method for auditory captchas

ABSTRACT

Disclosed herein are systems, methods, and computer readable-media for performing an audible human verification. The method includes determining that a human verification is needed, presenting an audible challenge to a user which exploits a known issue with automatic speech recognition processes, receiving a response to the audible challenge, and verifying that a human provided the response. The known issue with automatic speech recognition processes can be recognition of a non-word, in which case the user can be asked to spell the recognized non-word. The known issue with automatic speech recognition processes can be differentiation of simultaneous input for multiple audio streams. Multiple audio streams contained in the audible challenge can be provided monaurally. Verifying that a human provided the response can include confirming the contents of one of the multiple audio streams. Audible human verification can be performed in combination with visual human verification.

PRIORITY

The present application is a continuation of U.S. patent applicationSer. No. 12/197,503, filed Aug. 25, 2008, the content of which isincorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to user verification and more specificallyto auditory verification of a human user.

2. Introduction

Computer systems are capable of mimicking human interactions with othercomputers. One computer can be programmed to fill in forms, submit thoseforms, and generally behave in an automated way to accomplish certaintasks, especially in on-line forums like bulletin boards, blogs, onlinepolls, commerce sites, and so forth. While many such automation tasksare benign and even helpful, the same technology can be used to automatefraud and/or attacks. In response to increasing automated attacks, theconcept of a Completely Automated Public Turing test to tell Computersand Humans Apart, or CAPTCHA, was conceived. A CAPTCHA is an imagedesigned to be difficult or impossible to solve in an automated way, butalso designed so that most humans can solve the CAPTCHA. An idealCAPTCHA also retains these two attributes even after many websitesimplement it.

A CAPTCHA graphic usually contains numbers, letters, or some combinationof characters. Typically a visual CAPTCHA further employs one or more ofthe following techniques to alter the text in order to frustratewould-be automated attacks: warping, distorting the background, addingnoise, crowding characters together, etc. These techniques make opticalcharacter recognition (OCR) difficult or impossible, but must notdistort the text to the point that a human would also be unable tounderstand the CAPTCHA contents. In fact, one of the early attempts atCAPTCHAs intentionally exploited known problems in OCR systems bysimulating situations that scanner manuals claimed resulted in faultyOCR. Attackers quickly adapted and were able to defeat early rudimentaryCAPTCHA technology.

As computing power and OCR technology advances, CAPTCHA creators andwould-be attackers using OCR find themselves in a continuing arms race.CAPTCHA creators find a new way to stump automated attacks and attackerswork quickly to find a way to work around the problem. Some notablevictims in the CAPTCHA arms race who have had their CAPTCHA technologycompromised are online heavyweights such as Yahoo, Paypal, Microsoft,and Google. Even successful CAPTCHAs are susceptible to circumvention bymeans of paying humans in third world countries pennies for eachcompleted CAPTCHA.

With recent discoveries and advancements in automated speech synthesisand recognition, automated interactions are now rapidly spreading totelephone-based interfaces. Automated attacks encountered on the web arenow finding their way into automated telephone interfaces. However, thetraditional CAPTCHAs which were designed to prevent and/or slow downautomated attacks are graphics based. Telephone systems are nottypically capable of displaying images, so the graphical CAPTCHAapproach is not applicable. An audible CAPTCHA is the only solutionuniversally applicable to all telephones. Efforts to date to create anaudible CAPTCHA system simply extend the visual metaphor of degradingthe stimulus by adding noise, but such noise is easily filtered out withthe help of computer software. Accordingly, what is needed in the art isan improved way to tell humans apart from computers based on audibleCAPTCHAs.

SUMMARY

Additional features and advantages of the invention will be set forth inthe description which follows, and in part will be obvious from thedescription, or may be learned by practice of the invention. Thefeatures and advantages of the invention may be realized and obtained bymeans of the instruments and combinations particularly pointed out inthe appended claims. These and other features of the present inventionwill become more fully apparent from the following description andappended claims, or may be learned by the practice of the invention asset forth herein.

Disclosed are systems, methods, and tangible computer readable-media forperforming an audible human verification. The method includesdetermining that a human verification is needed, presenting an audiblechallenge to a user which exploits a known issue with automatic speechrecognition processes, receiving a response to the audible challenge,and verifying that a human provided the response. The known issue withautomatic speech recognition processes can be recognition of a non-word,in which case the user can be asked to repeat back or spell therecognized non-word. The known issue with automatic speech recognitionprocesses can be differentiation of simultaneous input for multipleaudio streams. Multiple audio streams contained in the audible challengecan be provided monaurally. Verifying that a human provided the responsecan include confirming the contents of one of the multiple audiostreams. Audible human verification can be performed in combination withvisual human verification. An analogous visual concept is known as aCompletely Automated Public Turing Test to tell Computers and HumansApart, or CAPTCHA. One purpose of CAPTCHAs is to prevent automated abuseof publicly available websites. Many forms of visual CAPTCHAs exist andare constantly refined in response to improving optical characterrecognition (OCR) technology. This disclosure addresses the need in theauditory field for improved audible CAPTCHAs where more traditionalgraphical CAPTCHAs are impractical, ineffective, or inadequate.

Since the likely and most common computer processing used to answerauditory challenges is ASR, both disclosed approaches leverage theunique advantages of humans as sensory processors over currentcapabilities of ASR systems.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to describe the manner in which the above-recited and otheradvantages and features of the invention can be obtained, a moreparticular description of the invention briefly described above will berendered by reference to specific embodiments thereof which areillustrated in the appended drawings. Understanding that these drawingsdepict only exemplary embodiments of the invention and are not thereforeto be considered to be limiting of its scope, the invention will bedescribed and explained with additional specificity and detail throughthe use of the accompanying drawings in which:

FIG. 1 illustrates an example system embodiment;

FIG. 2 illustrates a functional block diagram of an exemplary naturallanguage spoken dialog system;

FIG. 3 illustrates an example method embodiment;

FIG. 4 illustrates an example system embodiment;

FIG. 5A illustrates a steady wave form;

FIG. 5B illustrates an increasing wave form;

FIG. 5C illustrates the sum of the steady and increasing wave forms;

FIG. 6A illustrates speech wave form 1;

FIG. 6B illustrates speech wave form 2; and

FIG. 6C illustrates the sum of the speech wave forms 1 and 2.

DETAILED DESCRIPTION

Various embodiments of the invention are discussed in detail below.While specific implementations are discussed, it should be understoodthat this is done for illustration purposes only. A person skilled inthe relevant art will recognize that other components and configurationsmay be used without parting from the spirit and scope of the invention.

With reference to FIG. 1, an exemplary system includes a general-purposecomputing device 100, including a processing unit (CPU) 120 and a systembus 110 that couples various system components including the systemmemory such as read only memory (ROM) 140 and random access memory (RAM)150 to the processing unit 120. Other system memory 130 may be availablefor use as well. It can be appreciated that the invention may operate ona computing device with more than one CPU 120 or on a group or clusterof computing devices networked together to provide greater processingcapability. The system bus 110 may be any of several types of busstructures including a memory bus or memory controller, a peripheralbus, and a local bus using any of a variety of bus architectures. Abasic input/output (BIOS) stored in ROM 140 or the like, may provide thebasic routine that helps to transfer information between elements withinthe computing device 100, such as during start-up. The computing device100 further includes storage devices such as a hard disk drive 160, amagnetic disk drive, an optical disk drive, tape drive or the like. Thestorage device 160 is connected to the system bus 110 by a driveinterface. The drives and the associated computer readable media providenonvolatile storage of computer readable instructions, data structures,program modules and other data for the computing device 100. In oneaspect, a hardware module that performs a particular function includesthe software component stored in a tangible computer-readable medium inconnection with the necessary hardware components, such as the CPU, bus,display, and so forth, to carry out the function. The basic componentsare known to those of skill in the art and appropriate variations arecontemplated depending on the type of device, such as whether the deviceis a small, handheld computing device, a desktop computer, or a computerserver.

Although the exemplary environment described herein employs the harddisk, it should be appreciated by those skilled in the art that othertypes of computer readable media which can store data that areaccessible by a computer, such as magnetic cassettes, flash memorycards, digital versatile disks, cartridges, random access memories(RAMs), read only memory (ROM), a cable or wireless signal containing abit stream and the like, may also be used in the exemplary operatingenvironment.

To enable user interaction with the computing device 100, an inputdevice 190 represents any number of input mechanisms, such as amicrophone for speech, a touch-sensitive screen for gesture or graphicalinput, keyboard, mouse, motion input, speech and so forth. The input maybe used by the presenter to indicate the beginning of a speech searchquery. The device output 170 can also be one or more of a number ofoutput mechanisms known to those of skill in the art. In some instances,multimodal systems enable a user to provide multiple types of input tocommunicate with the computing device 100. The communications interface180 generally governs and manages the user input and system output.There is no restriction on the invention operating on any particularhardware arrangement and therefore the basic features here may easily besubstituted for improved hardware or firmware arrangements as they aredeveloped.

For clarity of explanation, the illustrative system embodiment ispresented as comprising individual functional blocks (includingfunctional blocks labeled as a “processor”). The functions these blocksrepresent may be provided through the use of either shared or dedicatedhardware, including, but not limited to, hardware capable of executingsoftware. For example the functions of one or more processors presentedin FIG. 1 may be provided by a single shared processor or multipleprocessors. (Use of the term “processor” should not be construed torefer exclusively to hardware capable of executing software.)Illustrative embodiments may comprise microprocessor and/or digitalsignal processor (DSP) hardware, read-only memory (ROM) for storingsoftware performing the operations discussed below, and random accessmemory (RAM) for storing results. Very large scale integration (VLSI)hardware embodiments, as well as custom VLSI circuitry in combinationwith a general purpose DSP circuit, may also be provided.

The logical operations of the various embodiments are implemented as:(1) a sequence of computer implemented steps, operations, or proceduresrunning on a programmable circuit within a general use computer, (2) asequence of computer implemented steps, operations, or proceduresrunning on a specific-use programmable circuit; and/or (3)interconnected machine modules or program engines within theprogrammable circuits.

FIG. 2 illustrates a functional block diagram of an exemplary naturallanguage spoken dialog system. The principles of enriched spokenlanguage translation described herein can be implemented as a part of oroperate in connection with a natural spoken language dialog system toprovide, for example, real-time translation of speech in an automatednatural speech interface via telephone. In this manner, a spoken dialogsystem which is tuned to pick up on and understand prosodicallyprominent segments of speech can still be effective with foreignlanguages processed through a translation module. Spoken dialog systemsaim to identify intents of humans, expressed in natural language, andtake actions accordingly, to satisfy their requests. Natural languagespoken dialog system 200 may include an automatic speech recognition(ASR) module 202, a spoken language understanding (SLU) module 204, adialog management (DM) module 206, a spoken language generation (SLG)module 208, and synthesizing module 210. The synthesizing module may beany type of speech output module. For example, it may be a modulewherein one of a plurality of prerecorded speech segments is selectedand played to a user. Thus, the synthesizing module represents any typeof speech output. The present invention focuses on innovations relatedto the dialog management module 206 and may also relate to othercomponents of the dialog system.

ASR module 202 may analyze speech input and may provide a transcriptionof the speech input as output. SLU module 204 may receive thetranscribed input and may use a natural language understanding model toanalyze the group of words that are included in the transcribed input toderive a meaning from the input. The role of DM module 206 is tointeract in a natural way and help the user to achieve the task that thesystem is designed to support. DM module 206 may receive the meaning ofthe speech input from SLU module 204 and may determine an action, suchas, for example, providing a response, based on the input. SLG module208 may generate a transcription of one or more words in response to theaction provided by DM 206. Synthesizing module 210 may receive thetranscription as input and may provide generated audible speech asoutput based on the transcribed speech.

Thus, the modules of system 200 may recognize speech input, such asspeech utterances, may transcribe the speech input, may identify (orunderstand) the meaning of the transcribed speech, may determine anappropriate response to the speech input, may generate text of theappropriate response and from that text, may generate audible “speech”from system 200, which the user then hears. In this manner, the user cancarry on a natural language dialog with system 200. Those of ordinaryskill in the art will understand the programming languages and means forgenerating and training ASR module 202 or any of the other modules inthe spoken dialog system. Further, the modules of system 200 may operateindependent of a full dialog system. For example, a computing devicesuch as a smartphone (or any processing device having a phonecapability) may have an ASR module wherein a user may say “call mom” andthe smartphone may act on the instruction without a “spoken dialog.”

Having discussed these fundamental concepts, the disclosure turns to theexemplary method embodiment, variations, and the remaining figures. Oneof the primary benefits of the principles described herein is theability to prevent computer robots from automatically logging in andregistering for services by screening them out. FIG. 3 illustrates anexample method embodiment. The method includes first determining that ahuman verification is needed (302). A system with a telephone-basedinterface can make such a determination. A web-based system can alsodecide to employ an auditory CAPTCHA through a computer speaker, amicrophone, a keyboard, and/or mouse. For example, if a caller isinteracting with a speech-based interface for a bank and the callerwants to transfer funds, the bank's system can decide that it needs toverify that the caller is a person, not an automated attacker. A humandetermination can be provided in addition to and/or in combination withother security measures. For instance, while the caller to the bank haslikely already entered account information and provided sufficient meansof identification, the human verification can prevent would-be identitythieves from committing automated abuse of the bank's speech-basedinterface with stolen information.

Auditory CAPTCHAs can be combined with voice authorization securitymeasures known commonly as speaker verification. A spoken response to anauditory CAPTCHA can be retained and compared to an authorized speechsample to verify that not only is the speaker a human, but that thespeaker is a particular, authorized human. This particular aspect may beuseful in conjunction with automated credit card transactions over thephone.

Auditory CAPTCHAs can also be combined with security through something aspeaker knows. An auditory CAPTCHA can prompt a voice response thatserves two purposes. First, the voice response can demonstrate that aperson, and not an automated system, is providing the voice response.Second, the voice response can demonstrate that the person knows aparticular piece of information such as a password, passphrase, operatorID, etc. Such a prompt could contain two voices, for example one femaleand one male, one of which prompts the user “Please state the color ofthe sky followed by your passphrase.” The voice response can then notonly verify that the response comes from a person because she can pickout the prompt from two voices, but can also respond to the question andprovide a valid passphrase. Combinations with other security techniquesexist and should be readily apparent to one of skill in the art.

Next the method includes presenting an audible challenge to a user whichexploits a known issue with automatic speech recognition processes(304). Two primary known issues with automatic speech recognition areeasily exploitable. Other issues with ASR processes exist and may beexploited in their own unique ways. Two primary issues are discussed byway of example, but should not be considered limiting of the scope ofthe invention. The first known issue is recognition of a non-word. Asnon-words are not in an ASR grammar, a computer system or automated ASRbot would not recognize such a non-word, whereas a person would have noproblem recognizing a non-word and conjecturing as to a likely spelling.Some examples of non-words are “clammage”, “brillig”, “poiled”,“skring”, etc. One way to demonstrate recognition of a non-word is torequire a listener to spell the recognized non-word. One approach toverify spelling is to provide a table of acceptable spellings for eachnon-word. For instance, a user who is asked to spell “clammage” maythink it is etymologically similar to “rummage” and spell it with twoMs, or she may think it is similar to the word “damage” and spell itwith one M. A table of spellings includes satisfactory variations.

The second known issue in ASR systems is differentiation of simultaneousinput for multiple audio streams. The multiple audio streams can be, forexample, a male and a female voice, or an adult's and a child's voice,speaking different things at the same time. One way to demonstraterecognition and understanding is to simply ask what one of these voicesstated. ASR technology is currently incapable of segregating two or moresimultaneous auditory streams, but this is a trivial task for the humanear and brain. To prevent obvious attack tricks, if the audiblechallenge is provided in digital form such as an MP3 file, the multipleaudio streams contained in the audible challenge can be providedmonaurally in a single, merged structure. An automated attack to defeatan audio CAPTCHA with multiple streams could easily separate out tracks,such as stereo track information. A monaural digital file contains onlyone track which is not easily divisible, if at all.

These two known issues with ASR systems are combinable. For example, aCAPTCHA could include two simultaneous audio streams which say differentwords, one a real word and the other a non-word. The user can be askedto identify and spell the non-word. In this manner, two nearlyimpossible hurdles are presented for an ASR system, while a person caneasily discern the two words, identify the non-word, and formulate apossible spelling. Other ASR issues can be discovered and combined withknown issues. As ASR technology advances, issues can shift, alter,disappear, and reappear in various forms. It is anticipated that audioCAPTCHAs will evolve along with issues in the current level of ASRtechnology.

Next the method includes receiving a response to the audible challenge(306). A user or an automated system provides a response to the audiblechallenge. The response can be speech, button presses, typed words,mouse clicks, silence, an uploaded file or any other suitable type ofinput. Finally, the method includes verifying that a human provided theresponse (308). In the case of multiple audio streams, verifying that ahuman provided the response can include confirming the contents of oneor more of the multiple audio streams or answering a question about thecontents of one or more of the multiple audio streams. In the case ofnon-words, verifying that a human provided the response can includechecking a spoken or typed spelling of a word against a database ofacceptable spellings.

The audible human verification described herein can be performed incombination with graphical CAPTCHAs or other human verification schemes.In some cases, both the audible and visual CAPTCHAs are related andintegral to each other, so that one or the other is unusable without theother. For example, a visual CAPTCHA can be presented that is severelydistorted and nearly impossible for a human to read. In combination withan audio CAPTCHA as described herein, a clue is provided to allow ahuman to understand the visual CAPTCHA. In this way, a dual-factor testfor a human is applied so that even if a machine is able to decode oneor the other, the entire scheme is not compromised.

A telephone caller can initiate human verification to verify that theother party is a person. For example, a homeowner can establish an audioCAPTCHA to “guard” her home phone line. Every caller to the homeownermust pass an audio CAPTCHA to gain access and place a call. While thismay be a slight annoyance to many human callers, the homeowner canbalance that slight annoyance with the desire to avoid calls fromautomated systems. Alternately, the homeowner can provide a whitelist ofnumbers which are not subject to the audio CAPTCHA while all othernumbers must pass the audio CAPTCHA to place a call. Such a CAPTCHA canbe modified even further to ensure that the caller is not only a human,but a human who knows the homeowner. If the audio CAPTCHA is of themultiple audio stream kind, one of the audio streams may be thehomeowner's voice. The question of the CAPTCHA could ask, “Is thehomeowner's voice one of the voices presented?” or “What is thehomeowner saying in this clip?” In this way, not only are automatedtelemarketers blocked from making calls, but also humans who areunfamiliar with the homeowner's voice, such as human telemarketers.

FIG. 4 illustrates an example system embodiment. An example audioCAPTCHA system 400 accepts telephone calls from callers using landlines402, callers using cellular phones 404, callers using VoIP software on apersonal computer 406, and computers 408 by themselves via modem orother devices capable of communicating via a telephone connection. Atypical audio CAPTCHA system contains a telephone interface module 410to interact with callers via ASR. In the case of a computer calling byitself, the CAPTCHA system ASR is actually interacting with another ASRdesigned to attack or spoof the system. While a telephone interfacemodule is shown, the audio CAPTCHA system could be implemented as partof a web server which does not include phone lines at all. The telephoneinterface module 410 is coupled with a primary system 412 to providesome benefit to callers. Some examples of primary systems includesystems to provide access to banking, appointment scheduling, telephonicvoting, web sites, online commerce, technical support, insurance claimsfiling, bill payment, etc. Auditory CAPTCHAs can be applied to almostany currently existing primary system 412 which is accessible viatelephone.

When the primary system 412 determines that human verification isneeded, it signals the CAPTCHA module 414. The CAPTCHA module 414 isshown as connected to the telephone interface module, but it may beconnected to the primary system 412 in addition or it may be connectedonly to the primary system 412. The CAPTCHA module 414 or the primarysystem 412 can determine which type of audible challenge to present tothe user. In this figure, two types of audible challenges areillustrated: spelling a non-word and understanding a portion of amulti-stream audio signal. In the case of spelling a non-word, theCAPTCHA module 414 retrieves a non-word, such as “skring”, andassociated spellings, such as “s-k-r-i-n-g, s-c-r-i-n-g, s-c-r-e-e-n-g”from the database of non-words and spellings 416. The CAPTCHA module 414transmits that information to the telephone interface module 410 whichprepares and presents the audible CAPTCHA to the intended user, such as“Spell the imaginary word ‘skring’.” The user responds to the audiblechallenge with a spelling, such as “S-C-R-I-N-G”. The telephoneinterface module 410 converts the user's response and transmits it tothe CAPTCHA module 414. The CAPTCHA module 414 verifies the responsethen signals to the primary system 412 whether the user is approved ornot.

In the case of understanding a portion of a multi-stream audio signal,the CAPTCHA module 414 can retrieve multiple audio streams from thedatabase of individual audio streams 418 and combine them on the fly.Alternatively, the CAPTCHA module 414 can retrieve pre-combined streamsfrom a database of combined audio streams 420. These two databases 418,420 can also include associated meaning information such as strings, keywords, key phrases, answers to questions in the audio streams, etc. TheCAPTCHA module 414 transmits the stream or streams to the telephoneinterface module 410 which prepares and presents the audible CAPTCHA tothe intended user, such as “Please listen to the following audio clip.Afterwards, please answer the question asked by the male speaker.” Theaudio clip contains two voices speaking simultaneously, a female and amale. The female voice says “What ocean is to the west of SouthAmerica?” The male voice says “What color is the inside of awatermelon?” A human user can very easily distinguish between the twovoices and formulate a correct response, “Red”. An ASR engine would beunable to properly distinguish between the two audio streams and couldnot respond in a meaningful fashion. The telephone interface module 410converts the received response and transmits it to the CAPTCHA module414. The CAPTCHA module 414 verifies the response then signals to theprimary system 412 whether the user is approved or not. Connectionsshown in FIG. 4 may be direct wired connections, wireless connections,packet-based communications over a network such as the Internet, etc.

FIGS. 5A, 5B, and 5C illustrate waveforms of two dissimilar tones andhow they can be combined. FIG. 5A illustrates a steady wave form. Such awave form is consistent with a steady tone, such as a steady beepingnoise. The relatively long wavelength means this wave is a lower pitch.FIG. 5B illustrates a wave form which is increasing in amplitude. Such awave form is consistent with a steady tone that is increasing in volume.The relatively short wavelength means this wave is a higher pitch. FIG.5C illustrates the sum of the steady and increasing wave forms. FIG. 5Cdemonstrates the fundamental principle of how to combine waveforms. Itis a simple example of how distorted a sum of two signals can become,even when the source signals are “pure” and mathematically simple toexpress.

Next, we turn to FIGS. 6A, 6B, and 6C to show how combining multipleaudio signals containing speech generates a sum wave that is nearlyimpossible for a computer to separate into its constituent elements.FIG. 6A illustrates speech wave form 1. It is not consistent or cyclicalas shown in FIG. 5A and 5B. It contains many quiet periods of no speech.It contains waves of varying wavelengths, amplitudes, and frequencies.Overall, it is very representative of the relative low-level chaos ofwave forms of conversational speech. FIG. 6B illustrates speech waveform 2. Wave form 2 demonstrates a very different type of wave withdifferent patterns, but still very representative of speech-based waves.Speech recognition is a difficult enough on a single voice, but speechrecognition becomes a nearly intractable task when two voices aresuperimposed one on the other. FIG. 6C illustrates the sum of the speechwave forms 1 and 2. As two complex wave forms are combined, the resultis a very messy wave form. A computer-based ASR system is only able todifferentiate where one wave form ends and the other one begins withgreat difficulty, if at all. Such a task is trivial for a human being,however. Humans are able to process and comprehend the wave forms at avery high level without thought about the individual wave forms, whereasa computer is limited to a wave form analysis for understanding of thewave form. This weakness is well known in ASR systems. A wave form likeFIG. 6C is capable of straightforward resolution by a person, but not bya computer.

Embodiments within the scope of the present invention may also includecomputer-readable media for carrying or having computer-executableinstructions or data structures stored thereon. Such computer-readablemedia can be any available media that can be accessed by a generalpurpose or special purpose computer. By way of example, and notlimitation, such computer-readable media can comprise RAM, ROM, EEPROM,CD-ROM or other optical disk storage, magnetic disk storage or othermagnetic storage devices, or any other medium which can be used to carryor store desired program code means in the form of computer-executableinstructions or data structures. When information is transferred orprovided over a network or another communications connection (eitherhardwired, wireless, or combination thereof) to a computer, the computerproperly views the connection as a computer-readable medium. Thus, anysuch connection is properly termed a computer-readable medium.Combinations of the above should also be included within the scope ofthe computer-readable media.

Computer-executable instructions include, for example, instructions anddata which cause a general purpose computer, special purpose computer,or special purpose processing device to perform a certain function orgroup of functions. Computer-executable instructions also includeprogram modules that are executed by computers in stand-alone or networkenvironments. Generally, program modules include routines, programs,objects, components, and data structures, etc. that perform particulartasks or implement particular abstract data types. Computer-executableinstructions, associated data structures, and program modules representexamples of the program code means for executing steps of the methodsdisclosed herein. The particular sequence of such executableinstructions or associated data structures represents examples ofcorresponding acts for implementing the functions described in suchsteps.

Those of skill in the art will appreciate that other embodiments of theinvention may be practiced in network computing environments with manytypes of computer system configurations, including personal computers,hand-held devices, multi-processor systems, microprocessor-based orprogrammable consumer electronics, network PCs, minicomputers, mainframecomputers, and the like. Embodiments may also be practiced indistributed computing environments where tasks are performed by localand remote processing devices that are linked (either by hardwiredlinks, wireless links, or by a combination thereof) through acommunications network. In a distributed computing environment, programmodules may be located in both local and remote memory storage devices.

The various embodiments described above are provided by way ofillustration only and should not be construed to limit the invention.For example, the principles herein may be applied to any telephone-basedsystems or other auditory communication and computer systems wherevisual analogue is not possible. Those skilled in the art will readilyrecognize various modifications and changes that may be made to thepresent invention without following the example embodiments andapplications illustrated and described herein, and without departingfrom the true spirit and scope of the present invention.

We claim:
 1. A method comprising: presenting an audible challenge to auser device which exploits a previously detected issue with automaticspeech recognition processes, where the audible challenge comprisespresenting an audible pronunciation of a non-word pronounced like asingle word, wherein the non-word does not exist in a vocabulary ofnatural languages, and requesting a user of the user device to spell thenon-word; receiving an audible response to the audible challenge; andverifying an identity of the user based on the audible response.
 2. Themethod of claim 1, wherein the previously detected issue with automaticspeech recognition processes further comprises spelling of the non-word.3. The method of claim 1, further comprising receiving multiple audiostreams simultaneously, wherein one of the multiple audio streams is theaudible response.
 4. The method of claim 3, wherein the previouslydetected issue with automatic speech recognition processes isdifferentiation of simultaneous input for the multiple audio streams. 5.The method of claim 3, wherein, when the audible challenge is providedin digital form, the multiple audio streams contained in the audiblechallenge are provided monaurally.
 6. The method of claim 3, whereinverifying the identity of the user comprises analyzing contents of oneof the multiple audio streams.
 7. The method of claim 1, wherein theaudible challenge comprises a plurality of different words, where one ofthe plurality of different words is the non-word and another of theplurality of different words is a word which exists in the vocabulary ofnatural languages.
 8. A system comprising: a processor; and acomputer-readable storage medium having instructions stored which, whenexecuted by the processor, cause the processor to perform operationscomprise: presenting an audible challenge to a user device whichexploits a previously detected issue with automatic speech recognitionprocesses, where the audible challenge comprises presenting an audiblepronunciation of a non-word pronounced like a single word, wherein thenon-word does not exist in a vocabulary of natural languages, andrequesting a user of the user device to spell the non-word; receiving anaudible response to the audible challenge; and verifying an identity ofthe user based on the audible response.
 9. The system of claim 8,wherein the previously detected issue with automatic speech recognitionprocesses further comprises spelling of the non-word.
 10. The system ofclaim 8, the computer-readable storage medium having additionalinstructions stored which result in operations comprising receivingmultiple audio streams, wherein one of the multiple audio streams is theaudible response.
 11. The system of claim 10, wherein the previouslydetected issue with automatic speech recognition processes isdifferentiation of simultaneous input for the multiple audio streams.12. The system of claim 10, wherein, when the audible challenge isprovided in digital form, the multiple audio streams contained in theaudible challenge are provided monaurally.
 13. The system of claim 10,wherein verifying the identity of the user comprises analyzing contentsof one of the multiple audio streams.
 14. The system of claim 8, whereinthe audible challenge comprises a plurality of different words, whereone of the plurality of different words is the non-word and another ofthe plurality of different words is a word which exists in thevocabulary of natural languages.
 15. A computer-readable storage devicehaving instructions stored which, when executed by a computing device,cause the computing device to perform operations comprise: presenting anaudible challenge to a user device which exploits a previously detectedissue with automatic speech recognition processes, where the audiblechallenge comprises presenting an audible pronunciation of a non-wordpronounced like a single word, wherein the non-word does not exist in avocabulary of natural languages, and requesting a user of the userdevice to spell the non-word; receiving an audible response to theaudible challenge; and verifying an identity of the user based on theaudible response.
 16. The computer-readable storage device of claim 15,wherein the previously detected issue with automatic speech recognitionprocesses further comprises spelling of the non-word.
 17. Thecomputer-readable storage device of claim 15, having additionalinstructions stored which result in operations comprising receivingmultiple audio streams, wherein one of the multiple audio streams is theaudible response.
 18. The computer-readable storage device of claim 17,wherein the previously detected issue with automatic speech recognitionprocesses is differentiation of simultaneous input for the multipleaudio streams.
 19. The computer-readable storage device of claim 17,wherein, when the audible challenge is provided in digital form, themultiple audio streams contained in the audible challenge are providedmonaurally.
 20. The computer-readable storage device of claim 17,wherein verifying the identity of the user comprises analyzing contentsof one of the multiple audio streams.